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SUMMARY 


&  class  of  survival  gamesfin  an 
arbitrary  n— dimensional  region  R,  and' with  an 
arbitrary  payoff  function  f(x)  on  the  boundary. 

If  the  steps  are  uniformly  decreased  In  size, 
the  equations  specifying  the  changes  In  the 
state  of  the  game  tend  to  approxlMte  the  ,  . 

equations  of  a  differential  game. 

IriawdMMt  a^artlcular  class  of  gamesi^  In  which 
neither  pilfer  can  force  the  state  0“  the  •  P 

j  J  proceed  In  any  directions  •ee^eise»w^aeii^4t^.x.-o<^ 
^A^^^^lunder  certain  conditions,  the  upper  and  lower 

'  lvalues  of  the  aoDroxlmatlnR  xames  actually  converge 


'values  of  the  approximating  games  actually  converge 
to  the  same  function.  The  limiting  value  Is  given 
by  the  solution  of  L(V)  •  0,  with  boundary  value 
f(x),  where  L(V)  la  a  certain  second-order  dif¬ 
ferential  operator  associated  with  the  game.^  . 


t 
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ON  DIPPKRKNTIAL  (JAMES  WITH  SURVIVAL  PAYOFFS 
Herbert  Scarf 

In  a  paper  appearing  elsewhere  In  this  volume,  a  class 
of  differential  games  with  Integral  payoffs  Is  discussed  by 
Fleming  [5] .  The  games  are  defined  and  It  Is  shown  that, 
under  fairly  stringent  conditions,  the  game  will  have  a  value 
and  aaoh  player  will  possess  £-effectlve  strategies.  We  shall. 

In  this  paper,  discuss  differential  games  with  a  survival  payoff. 
Basically,  because  of  the  fact  that  survival  games  may  last  fcr 
an  Infinite  length  of  time,  and  the  games  discussed  In  the  ref¬ 
erence  mentioned  above  are  explicitly  limited  to  a  finite  time, 
the  techniques  available  for  the  treatment  of  survival  games 
are  more  Involved  and  comparable  results  are  more  difficult  to 
obtain,  than  In  the  case  of  games  with  an  Integral  payoff.  For 
these  reasons,  the  emphasis  In  this  paper  will  be  on  proving  a 
result  which  Is  somewhat  weaker  than  the  existence  of  a  value  for 
survival  games.  What  we  shall  do  Is  define  a  series  of  approxi¬ 
mating  9unss  with  a  discrete  time  parameter,  and  show  that  under  con¬ 
ditions  similar  to  those  given  by  Fleming,  both  the  upper  and 
lower  values  of  the  approximating  games  converge  to  the  same 
limit,  as  the  grid  size  for  the  time  parsuneter  tends  to  zero. 

We  shall  not  make  any  statements  about  the  convergence  of 
optimal  strategies;  but.  Inasmuch  as  the  value  functions  for  the 
discrete  games  characterize  optimal  play,  their  limit  may  be  ex¬ 
pected  to  give  a  reasonable  Indication  of  the  limiting  character¬ 
istics  of  optimal  play. 
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The  discrete  games  that  we  are  Interested  in  are  readily 
seen  to  be  generalizations  of  the  survival  games  considered  by 
Hausner,  [8],  Pelsakoff,  [iS^  ,  Bellman,  [l,2],  Blackwell  [2], 

LiiSalle  [1],  and  Mllnor  and  Shapley  [ll].  We  consider  a  bounded 
n-<llmen8lonal  region  R,  with  boundary  B.  A  bounded  n— dimensional 
vector^valued  function  g(x;y,z)  Is  given,  which  for  eacn  x  In  R 
eltner  la  a  continuous  vec tor— valued  function  on  the  (y,z)  unit 
square,  or  Is  a  vec tor— valued  matrix.  The  game  Is  played  as 
follows:  A  vector  x^.  Interior  to  the  region  R,  Is  chosen.  On 

tne  first  move,  player  I  chooses  a  particular  value  of  y  and 
player  II  simultaneously  chooses  a  particular  value  of  z,  and 
subsequently  a  straight  line  la  drawn  from  the  point  x^  to  the 
point  Xi  -  Xq  >  players  then  make  another  choice 

of  y  and  s  and  wt  draw  a  atralght  line  fror  X|  to  ■  X|  ♦  6g(jiiiyfi)« 
Ihla  prooeas  la  repeated  until  the  path  penatratea  the  boundary » 
at  which  point  the  game  Is  terminated.  ITie  payoff  Is  defined 
as  follows:  We  have  a  function  b(x),  defined  and  continuous  on 
the  boundary  B;  if  the  game  terminates  at  the  point  x,  then  the 
payoff  to  the  first  player  Is  b(x),  and  the  second  player  receives 
the  negative  of  this  amount.  In  order  to  complete  the  definition 
of  the  game,  we  should  define  the  payoff  In  the  event  that  the 
game  does  not  terminate,  but,  as  we  shall  see,  this  Is  a  matter 
of  Indifference  to  us.  Of  course,  both  players  are  permitted  to 
use  BLlxed  strategies  at  every  stage  of  the  game.  In  order  to 
Indicate  the  dependence  of  this  game  upon  the  parameter  6  we 


shall  designate  this  game  by  0^. 
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As  6  tendrs  to  zero,  the  motion  of  the  game  tends  more 
and  more  to  be  described  by  the  equations  i  -  g(x;y,z),  and 
these  are  the  defining  equations  of  a  differential  game.  Let 
us  assume  for  the  moment  that  Og  has  a  value  Wg(x),  x  being 
the  Initial  starting  point.  We  shall  give  sufficient  conditions 
for  this  sequence  of  functions  to  converge,  and  also  obtain  a 
system  of  differential  Inequalities  whose  solution  represents 
the  limiting  function. 

Conditions  for  the  existence  of  Wg(x)  are,  at  present, 
known  only  for  the  one— dimensional  case,  but  as  we  stiall  see 
later  In  the  paper.  It  Is  not  necessary  to  assume  the  existence 
of  the  value.  It  will  actually  be  true  that  both  the  upper  and 
lower  values  (defined  appropriately)  will  converge  to  the  same 
limit.  We  define  W^(x)  to  be  the  best  that  player  I  can  guarante 
himself,  using  mixed  strategies.  In  0^ .  That  lo,  Wg  Is  the  Lup 
Inf  over  the  payoff,  In  mixed  strategies,  '^(x)  Is  defined  to 
be  the  Inf  Sup  of  the  payoff.  It  la  true  that  i  W^(X). 

II.  SURVIVAL  OAMSS  WITH  FINITE  TIME 

As  was  mentlonea  In  the  previous  section,  one  of  the  basic 
differences  between  survival  games  and  the  type  of  gamies  with 
Integral  payoffs  treated  by  Fleming  In  [p]  ,  Is  that  the  latter 
are  playea  for  a  finite  length  of  time,  whereas,  the  former  may 
continue  Indefinitely.  It  Is  possible  to  modify  survival  games 
80  as  to  make  them  last  for  a  finite  length  of  time,  and  we  shall 
devote  this  section  to  a  dlecusslon  of  games  of  this  sort.  The 
purpose  will  be  to  point  out  some  important  differences  between 
Infinite  survival  gan.es  and  their  finite  counterparts. 
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In  order  to  define  the  discrete  analogues  of  a  finite 

survival  game,  in  addition  to  the  data  given  in  Section  1,  we 

have  to  fix  a  tiae  T,  and  also  require  that  the  boundary  function 

b(x)  be  extended  continuously  throughout  the  interior  of  the 

region  R.  The  game  (x^,T)  is  defined  as  follows:  Starting 

n 

from  X  ,  a  broken  line  path  Is  constructed  from  x  to  Xi,  and 

o  o  * ' 

from  Xi  to  Xt ,  etc.  In  the  same  manner  as  In  the  Infinite  aur- 

T 

vlval  game  described  In  Section  I,  with  ^  this  path 

penetrates  the  boundary  before  time  T,  the  payoff  to  player  I 
Is  b(x),  and  the  negative  of  this  amount  to  player  II,  where  x 
Is  the  point  of  penetration.  If  penetration  does  not  occur 
before  time  T,  then  the  game  Is  stopped  at  time  T,  and  the  pay¬ 
off  is  b(x), where  x  is  the  position  at  time  T. 

It  Is  easy  to  see  that  Q,j,  (Xq»T)  has  a  value, 

n 

which  we  denote  by  (x^,T).  We  are  Interested  In  determining 

n 

a  Set  of  conditions  which  are  sufficient  to  Insure  that  (x^,T) 

n 

converges  as  n  becomes  Infinite. 

THEOREM  1.  IP  W(x,T)  IS  A  CONTINUOUSLY  DIFFERENTIABLE 
SOLUTION  OP  THE  EQUATION 

-  VAL  (  .  FOR  X  IN  THE  CLOSURE  OF  R 

AND  t  2 

WHICH  SATISFIES  THE  BOUNDARY  CONDITIONS 

1.  W(x,t)  -  b(x)  FOR  X  ON  THE  BOUNDARY,  AND  ANY  t,  AND 

2.  W(x,0)  -  b(x)  FOR  x  IN,  OR  ON  THE  BOUNDARY,  OF  R, 

LIM  W,j.  (x^,T)  -  W(Xo,T)  . 


THEN 
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result  may  be  proved  quite  easily,  either  by  an 
adaptation  of  the  argument  given  by  Fleming  In  [p] ,  or  by  a 
simple  argument  using  the  theory  of  martingales,  and  we  shall 
not  present  the  proof  here.  Actually,  one  can  go  even  further, 
and  show  that  W(Xq,T)  Is  the  value  of  the  limiting  finite— time 
survival  game.  If  this  game  is  defined  correctly. 

Theorem  1  suggests  that  the  values  of  the  discrete  analogues 
to  an  Infinite  survival  game  converge  to  the  solution  of 

Val  (  •  0»  which  satisfies  the 

boundary  condition  W(x)  •  b(x)  for  x  on  the  boundary.  In  genera^ 
this  Is  false.  The  simplest  way  to  see  that  this  conjecture  la 
false  Is  to  notice  that.  In  general,  the  functional  equation 
Val  (  ,g)  •  0,  with  the  associated  boundary  condition  possesses 

more  than  one  solution.  More  specifically,  there  Is  a  large  class 
of  functions  g,  for  which  the  equation 
3  w 

Val  (  »8)  ■  0  true  for  every 

continuously  differentiable  function  W.  The  class  of  survival 
games  which  have  this  property  are  the  furthest  removed.  In  both 
technique  and  final  results,  from  finite  survival  games,  and  It 
Is  this  class  of  games  which  we  shall  discuss  In  the  remainder 
of  this  paper. 
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III .  UNBIASED  DIFFERENTIAL  QAMKS 

In  the  previous  section  It  was  mentioned  we  ahall  restrict 
our  attention  to  a  specific  class  of  survival  gac.es,  which  we 
snail  call  unbiased  games.  T^ey  are,  roughly  speaking,  described 
by  saying  that  at  each  point  neither  player  can  force  any  par¬ 
ticular  direction. 

A  differential  game  Is  said  to  be  unbiased  If  for 
every  x  In  R ,  and  for  every  vector  c ,  the  scalar 
prx)duct  (c,g(x;yz)),  when  considered  as  a  ga/ne 
over  the  (y,z)  space,  has  value  zero. 

We  shall  dlscjsj  some  examples  of  unbiased  games  In  detail 
later  on,  but  let  us,  for  the  moment,  exan.lne  a  specific  game 
In  the  plane.  Let  the  region  and  the  boundary  value  be  arbitrary, 
and  let  g(x;y,z)  be  Independent  of  x  and  c^jual  to  the  matrix 


(1,0) 

(-1,0) 

(0,1) 

(0,-1) 

(0,-1) 

(1,0) 

(-1,0) 

(0,1) 

(0,1) 

(0,-1) 

(1,0) 

(-1,0) 

(-1.0) 

(0,1) 

(0,-1) 

(1.0) 

This  game  Is  a  specific  example  of  a  general  claas  of  un¬ 
biased  games,  l.e.,  when  g(x;y,z)  Is  given  by  a  cyclic  matrix 
with  row— sum  equal  to  zer*o  .  The  optimal  strategy  for  either 
player  In  any  projection  of  the  above  matrix,  l.e.,  for  any 
linear  combination  of  the  matrices.  Is  to  play  each  row,  or 
column,  with  prx>bablllty  one— fourth.  In  the  game  all  of 

the  elements  of  strategy  customarily  associated  with  a  game 
are  lacking;  If  both  players  play  optimally,  the  resulting 
stochastic  process  Is  a  simple  random  walk  in  which  the  point 
moves  by  an  amount  5,  with  probability  one— fourth  In  the  rwrth. 
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east,  south,  or  west  directions.  Wie  value  function  W^(xi,xt) 

•Atisfits  th«  equation 

Ik 

W5(X|,Xa)-  iW(Xj  iW5(xi,x»-6)-^  i^^(xi+6,xi)-f  ,x.m)  , 

and  l3  close  to  b(M)  when  x  la  near  the  boundary  point  It 
la  well-known  that,  aa  6  tends  to  zero,  these  functions  converge. 
The  limit  function  la  harmonic  In  R  and  aaaumeB  the  boundary 
value  b (x ) . 

In  the  general  case  our  results  will  be  somewhat  similar; 
the  primary  difference  will  be  the  replacement  of  the  Laplaclan 
by  a  considerably  more  complex  differential  operator.  We  need 
some  definitions . 

1.  We  define  to  be  the  first-order  llne&r  alfferentlal 

operator  T  g^(x;y,z)  -4r  .  lYie  operator  D*  Is  defined  to  bs 
k 

I  g^(x;y  ,z)g‘^(x;y  ,z)  ♦ 

K,/  *?X  X 

2.  We  define  the  operator  L(f)  to  be 

LU  Val  I  I  {D  -f  I  D»  )f  I  1/5  . 

^Is  latter  definition  is  very  Important  for  us,  and  needs 
some  comment.  Let  us  first  apply  this  definition  to  the  cyclic 
game  Just  discussed.  In  this  case  it  is  easy  to  verify  that  the 
matrix  1  |  (D  becomes 

y  4  L.  y  4 
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w 

7 

fi» 

ft 

■¥ 

7 

ftt 

•f 

6 

? 

fii 

-fi 

•¥ 

6 

7 

fii 

-f* 

6 

7 

fat 

fi 

-► 

6 

7 

fii 

ft 

h 

7 

fti 

1 

n 

■¥ 

6 

7 

ftt 

— f  1  -f  ^  f  1 1 

fi  +  I  f.i J 


wnlch  Is  Itself  cyclic  and  therefore  has  the  value  ^(^*1 1  ^  )  • 

If  we  divide  by  6  and  let  5  tend  to  zero,  we  see  that  L(f)  is* 
aside  from  a  constant  factor,  the  Laplacian. 

Another  interesting  case  occurs  when  the  functions  g(x;y,z) 
are  again  Independent  of  x  and  are  given  by  the  two-dimensional 
matrix 


/(l.O)  (-1,0)\ 

(-1,0)  (1,0) 

(0,1)  (0,-1) 

y(0,-l)  (0,1)  1 

This  game  la  unbiased,  and  the  matrix  j 1 (D 


yz 


*  I 


becomes 


The  mixlmlzer  can  ensure  himself  of  at  least  ^  Max  (fn,  fti) 
by  ^-laying  either  the  first  two  rows  (if  fii  2  ^sa)  last 

two  rows  (if  fga  >  1 1 )  with  equal  probabilities,  and  the  mlnlmlzer 
can  hold  him  to  at  most  this  amount  by  playing  the  two  columns 
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with  equal  probabilities.  It  follows  that  L(f)  ■  ^  Max  (fti*faa)* 

The  definition  of  L(f)  may  be  put  Into  another  form  by 

means  of  a  result  due  Independently  to  Gross  [7]  and  Hills  [lo3  • 

It  Is  based  on  the  observation  that  L(f)  Is  equal  to  the  derlva^ 

tlwe  of  Val  1 1 (D__  +  4  Dj_)fll  with  respect  to  5,  when  8  Is  zero, 
yz  c  y» 

LEMMA  I.  LET  P(f,x)  REPRESENT  THE  CLASS  OP  OPTIMAL 

STRATEGIES  FOR  THE  MAXIMIZING  PLATER  IN  THE  GAME  | |0„-f| |, 

y  ^ 

AND  Q(f,x)  THE  CORRESPONDING  CLASS  FOR  THE  MINIMIZING  PLAYER. 

THEN 

L(f)  -  MAX  MIN/^i  D*  (f)dp(y)dq(2)  . 
p£P  qtQ  y* 

There  Is  an  analogous  statement  for  matrices .  The  proof 
of  the  statement  for  matrices  may  be  found  In  the  paper  by 
Mills;  the  proof  of  the  statement  for  the  continuous  case  fol¬ 
lows  the  same  lines . 

IV.  THE  MAIN  RESULTS 

We  have  given  one  example,  the  cyclic  case,  in  which  the 
limit  of  the  value  functions  exists,  and  Is  equal  to  the  solu¬ 
tion  of  the  Laplace  equation  which  assumes  the  correct  boundary 
values,  that  Is,  which  Is  equal  to  b(x)  on  the  boundary.  In 
general,  the  result  will  be  analogous  to  this;  the  value  func¬ 
tions,  or.  If  these  do  not  exist,  the  upper  and  lower  values, 
will  converge  to  the  solution  of  L(f)  -  0,  which  Is  equal  to 
b(x)  on  the  boundary.  Our  actual  technique  will  be  to  approach 
this  result  from  above  and  below.  In  much  the  same  manner  that 


P-742 

^2-55 

-10- 

supep—  and  subharmonic  functions  may  be  used  to  approximate 
harmonic  functions. 

THBOREM  2.  LET  L(f)  BE  THE  OPERATOR  ASSOCIATED  WITH 
AN  UNBIASED  DIFFERENTIAL  OANE.  LET  f(x)  BE  A  FUNCTION  WITH 
CONTINUOUS  BOUNDED  DERIVATIVES  UP  TO  THE  THIRD  ORDER  IN  SOME 
OPEN  SET  S  CONTAINING  THE  CLOSURE  OF  R  IN  ITS  INTERIOR,  AND 
WHICH  SATISFIES  THE  CONDITIONS: 

1.  L{f)  2  c  >  0,  FOR  ALL  INTERIOR  POINTS  OF  R, 

2.  f(x)  ^  b(x)  FOR  X  ON  THE  BOUNDARY  B. 

THEN  LIN  Wc(x)  2  ^C*)* 

Let  us  first  of  all  choose  5  so  small  that,  if  x  Is  an 
Interior  point  of  R,  then  x  8g(x;y,z)  Is  In  S.  We  now  define 
a  strategy  for  the  first  player  In  0^,  by  defining  a  set  of 
probability  distributions  dp(y;x,6).  If  the  position  of  the 
game  Is  x,  then  the  first  player  Is  to  play  y  with  probability 
dp(y;x,5).  We  define  dp(y;x,8)  to  be  any  optimal  strategy  for 
the  first  player  In  the  game  (Dy^  j  ^  examine 

the  variations  In  the  function  f(x)  as  this  strategy  develops. 
We  know  that 

f(x  ■*.  8g(x;y,x))  -  fCx)  >  SDy^f(x)  ♦  |*Dj,f(x)  ♦  8»r(x,8), 

where  r(x,S)  Is  bounded  for  all  6  and  x  In  the  region.  If  we 
Imagine  the  play  to  have  started  at  x^,  and  If  (x^^)  represents 
a  typical  sequence  of  plays,  then  we  may  say  that 
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c6* 


The  way  In  which  we  have  chosen  the  strategy  tor  the  first 
player  implies  that 

E(f(x„)lXo . x„_j)  i  r(x^i)  +  -6*«, 

and  for  6  sufficiently  small 

E(f  1^0*  "  ■ ’*n-l^  -  ^^*n-l^ 

Since  the  function  f(x)  Is  bounded  Inside  the  region  R, 
we  can  deduce  that  with  probability  one  the  sequence  (x^)  will 
leave  the  region.  Let  n*  represent  the  random  variable  which 
is  the  length  of  time  that  the  process  continues;  that  Is,  n* 

Is  the  number  of  steps,  starting  from  x^and  continuing  until 
the  process  penetrates  the  boundary  for  the  first  time.  It  Is 
a  standard  result  from  the  theory  of  martingales  that  E(f (x^*) )>f (x^) 
[4,p.  502].  The  point  x^.  Is  within  &M  of  the  boundary  point 
X,  if  this  Is  the  point  of  penetration  of  the  boundary;  and 
since  f  is  continuous,  we  may  conclude  that  E{b)  ^  ^ » 

where  <?.  tends  to  zero  with  6.  It  follows  that  ^L^  2.  ^(^)* 

It  la  not  difficult  to  give  conditions  which  guarantee  that 
the  class  of  fxinctlons  satisfying  the  conditions  of  the  theorem 
Is  not  empty.  One  condition,  which  we  shall  not  use  later.  Is 
that  lg(x;y,z)l*  be  bounded  away  from  zero.  Consider  the  function 
f(x)  .  ^lxl*-d,  where  d  Is  a  positive  constant  chosen  so  large  as 
to  make  f(x)  less  than  the  minimum  of  b(x).  Then  equal 

to  lg(x;y,z)|*,  and  If  c  Is  positive  and  less  than  the  minimum 
of  Jlg(x;y,z)|*  we  easily  obtain 

^-k  Djz(^*)dp(y)dqC2)  2  c 
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for  any  distributions  p  and  q.  Applying  l>nuna  1,  we  see  that 
L(f)  >  c. 

It  Is  clearly  possible  to  reverse  the  conditions  of  Theorem  2, 
and  obtain  an  upper  bound  for  Llm  Wr(x) .  We  would,  in  this  case, 

5  ->0 

be  dealing  with  the  analogue  of  a  superharmonic  function.  Con¬ 
tinuing  In  this  spirit,  let  us  define  two  classes  of  functions. 

1 .  A  function  f (x)  will  be  'said  to  be  in  class  M^,  if  It  has 
continuous  bounded  derivatives  up  to  the  third  order  in  some  set 
containing  the  closure  of  the  region  R,  satisfies  L(f)  ^  c  >  0 

Inside  the  region,  and  Is  less  than  or  equal  to  b  on  the  boundary  . 

I  2.  A  function  f(x)  will  be  said  to  be  in  class  MT*  if  it 

I  has  continuous  bounded  derivatives  up  to  the  third  order  in  some 

open  set  containing  the  closure  of  the  region  R,  satisfies  ' 

5 

L(f)  ^  c  <  0  inside  the  region,  and  is  greater  than  or  equal 
to  b  on  the  boundary. 

Our  results  so  far  may  be  summarized  by  saying  that  any 
i  function  in  is  a  lower  bound  for  Llm  Wc(x) •  It  is  also 

j  troie  that  the  polntwlse  Sup  of  all  functions  in  M  ,  which  we 

!  denote  by  W*‘(x),  is  a  lower  bound  for 

I 

the  function  W”(x),  defined  to  be  the  polntwlse  Inf  of  all  func¬ 
tions  in  K”,  forms  an  upper  bound  for  (x) . 

Suppose  that  we  can  demonstrate  that  W‘*^(x)  •  W”(x)  ■  W. 

Then 

w’*‘(x)  ^  ^  wt(x)  ^  ns  Wg(x)  ^  vr(x). 

^50  6->o 

and  it  follows  that  wJCx)  and  Wg’(x)  both  converge  to  W.  Our 
goal  will  therefore  be  to  Impose  a  sufficient  number  of  condi¬ 
tions  on  the  differential  game  so  that,  first  of  all,  the  classes 
and  M*~  are  each  non-empty  and  second,  that  be  equal  to  W. 

We  shall,  in  the  following  theorem,  present  such  a  set  of  conditions. 


Lim  Wc(x);  and  similarly 
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They  are  certainly  unnecesearlly  strict,  and  It  Is  quite  prob¬ 
able  that  a  closer  analysis  of  the  problem  will  uncover  a  more 
satisfactory  set  of  sufficient  Conditions.  We  shall,  in  the 
discussion  following  the  theorem,  present  several  alternative 
sets  of  conditions. 

THEOREM  3.  LET  THE  FUNCTIONS  g(x;y,z)  HAVE  THE  PROPERTY 
THAT  ANY  PAIR  OF  OPTIMAL  STRATEGIES  IN  THE  SCALAR  PRODUCT  GAME 
(«»«(**/»*))#  WR  o  DIFFERENT  FROM  ZERO,  PRODUCE  E  {(c  ,g(aiy  »s)  )*}  >  0. 

UmFOSIfLI  IN  X. 

LET  W(x)  BE  A  FUNCTION  WITH  CONTINUOUS  BOUNDED  DERIVATIVES 
UP  TO  THE  THIRD  ORDER  IN  SOME  OPEN  SET  CONTAINING  THE  CLOSURE 

OF  R  IN  ITS  INTBRIGMy  AMD  WHICH  SATISFIES  TIB  OOHDITIOMSt 

1.  L(W)  -  0,  FOR  ALL  INTERIOR  POINTS  OF  R, 

2.  W(x)  -  b(x),  FOR  X  ON  THE  BOUNDARY  B, 

3.  THE  GRADIENT  OF  W  IS  DIFFERENT  FROM  ZERO  IN  R. 

THEN  Wg(x}  AND  Wg(x)  BOTH  CONVERGE  TO  V(x) . 

Let  us  first  notice  that  the  condition  imposed  on  the 
functions  g(x;y,z)  is  sufficient  to  guarantee  that  the  classes 
M'*'  and  M~  are  both  not  empty.  We  use  the  same  function  as  before, 
that  is,  f(x)  ■  4|x|*-d,  so  that  D*  (f)  «  lg(x;y,z)|*,  which  in 
turn  is  greater  than  1 (c,g(x;y,z) ) l*/!^ I*»  for  any  non-zero  c. 

It  follows  that  if  both  players  play  optimally  in  (a,g(x;y,z) ) , 

r 

then  E(Df_f)  >  0,  and  this  is  sufficient,  if  we  x*ecall  Lemma  1, 
yz 

to  put  f  in  M***.  In  a  similar  maumer,  a  member  of  may  be 
defined. 

All  that  remains  to  be  shown  is'  that  W*^  is  eqxial  to  W'~‘ . 


I 

i 

I  Let  U8  consider  the  functions  W-(x)  •  W(x)  — £IIM  b*(x)  ♦€¥*(*)• 

I  ^  x€B  . 

We  wish  to  show  that  each  one  of  these  functions  Is  In  N  .  It 

Is  clear  that  Wg{x)  ^  b{x),  for  x  on  the  boundary.  Let  us  now 

show  that  L(Wg)  >  0.  If  we  refer  to  Lenuna  1,  we  recall  that 

L(W£)  Is  equal  to  ^  Max  Min  players  play 

optimally  In  the  game  •  But  DyjW£  -  (l-f2£W)DyjW,  so  that 

If  t  Is  chosen  so  small  as  to  make  (1^2£W)  positive »  we  see  that 

j  L(Wc)  1®  equal  to  ^  Max  Min  when  both  players  play 

optimally  In  Dy^W.  But  since  1®  equal  to  Cl+2£W)I^jW4'2Ml>y*'^)** 

we  conclude  that  L(Wg)  -  (1^2£W)L(W)  2£B{(Dy^W)*}  .  Since 

I  L(W)  -  0,  and  our  assumptions  about  the  nature  of  g(xiy,s)  and 

I  the  non-vanlshlng  of  the  gradient  of  W  imply  that  sfCDy^W)*}  >  0, 

I  we  see  that  1i^  Is  In  M  . 

'I  W*^  was  defined  to  be  the  sup  of  all  elements  In  M*" ,  so 

,  that  W£  ^  W'*’.  When  6  tends  to  zero,  Wg  tends  to  W  so  that 

V  ^  V*.  In  the  same  manner  we  conclude  that  W  ^  ''*•  have 

vesMrked  previously  that  W"  2  It  Is  therefore  true  that 

v"*"  •  ■  W,  and  the  theorem  Is  proved. 

V.  REMARKS 

1.  We  would,  first  of  all,  like  to  comment  upon  some  of 
the  conditions  Imposed  In  Theorem  2.  There  are  many  examples 
In  which  the  conditions  of  Theorem  2  are  violated,  and  In  which 
convergence  occurs .  If  we  examine  the  exsmple  in  Section  ^ 

In  which  L(f)  turned  out  to  be  Max  (ft,fs)*  'f®  b®®  that  it 
violates  the  condition  that  optimal  strategies  in  any  projection 
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actually  produce  non— zero  motion  In  that  projection  (this  Is 
the  verbal  translation  of  the  first  condition  In  Theorem  3) . 

It  Is,  however,  true  that  If  L(W)  •  0,  then  L(W  ♦  ^«flx|*)l8 
greater  than  zero  for  positive  oC,  and  less  than  zero  for  negative 
oC.  This  Is  sufficient  to  prove  that  there  are  functlona  arbi¬ 
trarily  close  to  W  which  lie  In  and  ones  which  lie  In  M” , 
and  this  Is  the  basic  Idea  of  Theorem  2.  It  Is  also  possible. 

In  this  case,  to  dispense  with  the  condition  that  the  gradient 
of  W  be  different  from  zero.  In  general.  If  L(f  ♦  ^1*1*)  la 
greater  than  L(f)  for  sC  positive,  and  less  than  L(f)  for 
negative,  then  the  existence  of  a  solution  to  L(W)  ■  0,  with  , 
the  correct  boundary  conditions.  Is  sufficient  to  yield  the 
conclusion  of  Theorem  2.  It  would  be  very  Interesting  to  see 
what  classes  of  games  produce  operators  with  this  property. 

It  Is,  of  course,  the  non— linearity  of  the  operator  L(f)  which 
makes  It  difficult  to  obtain  any  general  results  about  Its 
behavior. 

2.  We  have  restricted  our  treatment  so  far  to  unbiased 
differential  games.  In  this  type  of  game,  neither  player  has 
the  option  of  forcing  the  expected  change  of  position  to  be 
In  a  favorable  direction.  He  must,  at  each  stage  of  the  game, 
rest  his  hopes  upon  the  variance  of  his  choices .  It  Is  pre¬ 
cisely  this  feature  of  unbiased  games  which  gives  rise  to 
operators  which  resemble  elliptic  second— order  differential 
operators . 

In  general,  survival  games  are  not  unbiased.  For  example. 

If  we  expect  the  limiting  game  to  have  pure  strategies  for  each 
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player,  then  It  seems  unreasonable  to  Impose  a  condition  which 
makes  the  choice  of  the  variance  the  only  strategic  element. 
It  Is  quite  possible,  however,  that  In  a  game  which  Is  not  un¬ 
biased,  the  players  may,  at  various  moments,  be  forced  to  pay 
some  attention  to  the  variance  of  their  moves,  so  that  the 
resulting  play  will  be  governed  by  a  combination  of  first—  and 
second-order  operators . 
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